General Disclaimer 


One or more of the Following Statements may affect this Document 


• This document has been reproduced from the best copy furnished by the 
organizational source. It is being released in the interest of making available as 
much information as possible. 


• This document may contain data, which exceeds the sheet parameters. It was 
furnished in this condition by the organizational source and is the best copy 
available. 


• This document may contain tone-on-tone or color graphs, charts and/or pictures, 
which have been reproduced in black and white. 


• This document is paginated as submitted by the original source. 


• Portions of this document are not fully legible due to the historical nature of some 
of the material. However, it is the best reproduction available from the original 
submission. 


Produced by the NASA Center for Aerospace Information (CASI) 



I »flp 



SECOrDARY T.\Civ iOR FjLL rLIGi'T L'IMiL,i7i0n IIICOU-OrAiTI.in TARIC 


COK’IOIJLY CAU'JE PITiOT ETiF;OR: TIME ESTIM’TIOII 


Final Technical Report coverine the period 1 Novenibor 19T*^ - 31 October 1975 
IIAOA-Ames University Consoi-tiura Interchange Agreement NCAP-07 a050-503 

(NASA-Tr.-X-7t1 = 3) SZCOt'DAFY ’’ARK Fn? FULL l!76-33eUtj 

FLIoHT SI^i'IIATIC'' lUCCFPOFMIM TASKS THA"^ 

COMMONLY CAUSE PILOT EFSOF: ESIIMATTCN 

Final T-^chnical Report, 1 Nov. 1974 - S'! Uncias 

Cct. 1975 (Caiiternia Univ.) 32 p HC i4. 0 G3/54 G~i80 


Principal Investigator: Dr. Eleanor Rosch 

Infaritute of Human Learning 
University of California 
Berkeley, California 9^720 


1 ASA Technical Officer: Mu’. Thoi.iaR Wempe 

t-lan-Mnchinc Integration Branch 
NASA -Ames Research Center 
Moffett FJeld, California 9^305 




SKOimARY TASK rOR FULL FLIGHT SI’UrATTOn IIICORPORM^ir. TASKi: TH/AT 
COMMONLY CA'JSK PILOT EIa<OR : TL’-T: IIITIi-iATION 

INTRODUCTION 

The objective of this Joint researcn proi^ntn v/os to provide numan 
factors investigators with an unobtrusive and miniroilly loading additional 
task tnat is ..ensitive to differences in Hying conditions and ilignt in- 
strumentation associated with the main task of piloting an aircraft sinulator. 
The additional task under investigation was time estimation, an activity oc- 
casionally performed by pilots during actual fliglit. Previous researen, sup- 
ported by NASA-Aines Consortiura Agreement NCAR-050-404, Indicated tnat the 
duration and consistency of time estimates is associated with the cognitive, 
perceptual, and motor loads itr?)osed by concurrent sinpile tasks. Thie present 
researen was aimed at clarifying the relationship between th'' length and varia 
bility of time estimates and concurrent task variables under a more congplex 
situation involving simulated flight. 

METHOD 

Commercial airline pilots, nine in tne first group and six in the second 
generated 10-sec time estimates using tne method of production. They began 
each estimate by tne activation of a switch, always in response to an auto- 
matically presented cue, and they terminated the estimate by another switen 
activation when they Judged that 10 sec had elapsed. Pilots in the first 
group produ‘.-’d time estimates in the absence of a concurrent task (baseline) 
and then under four different coa^lexity levels of a con^jensatory tracking 
task. At'ter baseline estinatlon, pilots in the second group produced esti- 
mates while flying a transport aircraft simulator under eight different 
combinations of wind velocity and flight instruments. 
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Tr.icklrv’ Tusk 

T!ie cciT?)ensutory tracklnc *ask, outlined In Figure 1, coisbined two levels 
of almension (one or two axis; with two levels of difficulty of tne quasi- 
random forcing function ("easy" or "hard", corresponding to low pass filtering 
at a frequency of 0.5 or 1.5 rad/sec respectively). The first-order control 
task consisted of attenuating to maintain eitner cr both of the horizontal and 
vertical driven lines at tne center of the display, superin^josed upon a fixed 
reference cross. Pilots produced seven 10-sec time estimates in tne absence of 
concurrent activity (baseline) and tnen again under each of tl\e four tracking 
conditions. The signal to begin eacn time estimate was the appearance of the 
phrase "10 SEC" across tne top of the display. That signal appeared lo sec 
after initiation of a tracking condition or termination of tne proceeding 
estimate. Actual intereatimate intervals typically varied between 10.7 and 13. 0 
sec dependir*g upon exactly wnen tne iTidividual pilots actually began eacn 
estimate. Tne design of the tracking esperiment is illustratea in Figure 2. 
Flight Simulation 

Tne flignt simulation involved two levels of each of three controlled 
variables: (a) wind velocity of either 4 or 32 knots, (b) presence or ab- 

sence of a flight path predictor, and (c) presence or absence of a graphic 
w..-.'i vector. The eight possible experimental conditions were balanced in 
presents ion across trials, pilots, and days, and all were given once on eacn 
of 4 different dtys. The pilots con 5 )leted participation in tne study over a 
period of between 4 and 8 days. Daily sessions lasted about 1.5 hr, and 
individual runs required approximately b min to fly. The design of the 
flight simulation experiment is illustrated in Figure 3. 



The fllpnt putn preai'’tor atici tne wind vector, when present, were 
eacn ^rapnic elements of a novin^ map display (P’ig'Jre 4) used by tne pilots 
for lateral coiiti'ol and navit;ation ox tne simulator, Tne preaictor orit:inated 
from the symbolized aiivroft position on tne nsjp. It dynamically reflected 
aircraft flltjnt i^haracteristico, pilot control inputs, ana 'wind effects, 
providing a 30 projection of tne route tnat tne simulated aircrait would 
fly under cyxsting conditions . Tlie wind vector displayed the direction and 
velocity of tne prcvailinf wind, and airci’aft drift due to vind was dynamically 
represented by the ancle between vector orrownoad and snaft. Pilots had the 
task of naintaininc tne simulated aircraft at 1,000 ft assigned altitude and of 
followinc the route of flight (Figure 5) depicted in tne map display as pre- 
cisely as possible. 

Pilots prod'iccd six 10-sec time estimates in the absence of concurrent 
activity (baseline) and then again under eacn of tne eignt experimental 
conditions during eacn of tne four days tney participated in the simulation. 

A 1,020 Hz tt- .e, and tne uppeai*ance of the phrase "EST 10 SBC" just to tne 
rignt of tne .light instruments, signalled the pi.lots to begin eacn estimate. 

The tone ceased once the estimate was begun, while tne phrase "10 SEC" per- 
sisted as a reminder tnat an estimate was in progress. Termination of an 
estimate caur 1 tne reminder phrase to disappear. Tlie signal to begin a time 
estimate occurred vnen tne simulated aircraft was at or abeam each of tne 
six geographical locations along tne assigned route of flight indicated in 
Figure 5 . The cue to begin tne first estimate occurred approximately 20 sec 
after initiation of flignt, w.iile tne interestimate intoxr/al, assuming tnat each 
estimate lasted appxroximotB ly 10 see, typically ranged between about 35 and 70 
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oCJ. Tiift lliglit inntrar!erit3 i‘cr:,'i I iiei ot^tl • In t:ic Lncclinc 'oridlticn, but 
pilots producea time c.'tln£Jtep ms thcat'b the siriulstor were flyinc the 
ass Ip, tied route. 

Rii;ULTS 

Baseline estlrcitos , produced in the absence ol a concurrent tt.SK, 
were consistent within individual pilots, penerallj' quite acr. urate, and 
appeared to be nora/illy distributed. With the addition of a concurrent 
task, Individual pilot's estimates become more variable, loss accurate, and 
were distributed with positive skewness.* Since skewness characterized 
the distributions of estimates produced with concurrent activity, the 
arithmetic mean misrepresented central tendency by givinp undue weight to the 
few particularly deviant (long) estimates (Figure 6). For exaiqile, tne meun 
was 1.0 sec longer than the median of estimates made during concurrent flying. 
However, tne mean ana median were approximately the same for baseline esti- 
mates, as one would expect from a norcsil distribution. Tlie median of each 
pilot's estirmtes within a session was tneretore cnosen os the more repre- 
sentative mtusure of central tendency. It follow thut tne average (absolute) 
deviation of scores from the median wns appropriate as u measure of dispersion. 

* The following descriptive statistics are mentioned in tiic discussion of 
experime. -ul results; 

Mean =^X/n 

Median (^4i) = point which divides the upper half of scores from the lower 

half: It is the centernost score for an odd number of scores 

and the moan of the two centermost scores for an even number. 

Average Deviation (AD) = 

Skewness (Gamma l) = 

Kurtosls (Gamma 2) - - X)Vn 

\(Z.(X - X)-/(n - 1))^ 



I(X - X)^/n 


X)V(n - 1))- 
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Trackla*’ 

Pilot performance ander the four traci'.iric condltlonc varied signifi- 
cantly as a l\;ncticn of the nar-ber of dircnsioiis and the difficulty of the 
forcing function. Trucking error increased as the number of axes controlled 
was increased from one to two and as task difficulty was increased from the 
easier to the more difficult forcing fun*tion. 

For the group of pilots who performed th.e tracking task, a slight 
increase in positive skewness charterized tht. distributicns of estimates 
made with, as compared to those made without concurrent tracking. Overall, 
estimate length increased by f;0^ and the average deviation increased by 
with the addition of con^iensatoi'y tracking (Figure T). 

Puririg concurrent tracking, positive sViewness Increased, median 
duration decreased, and average deviation incroased as the number of ccntrc-lled 
axes was increased from one to two (Figure 8). As the difficulty of the task 
was increased from the easier to the more difficult forcing function, there 
was a substantial increase in positive skewness, average deviation, and 
median estimate leng,th (Figure 9 ). 

Fligh t Simulation 

Piloting performance in control cf the simulator was assessed by 
measures of error in lateral guidance, err in maintaining assigne . altitude, 
aileron control activity, and elevator control activity. Scores on all 
measures increased significantly as wind velocity was increased from U to 
32 knots. The flight path predictor was associated with a significant 
decrease in lateral error and in aileron and elevator control activity, 
but altitude error was not significantly affected. An interaction with 
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aabjocts obccare'l the difference betwoo*. overall flyir^ precision and contrcl 
activity and the presence or ab’erice of the ^repnic wind vector. 

Althouch the centmL tendency and Jhcwi.eco of buseliiie csti'.»»i tea pro- 
duced by the pilots who flew the ai.calatcr were vii*t laily identical to those 
of the group of pilots who performed the tracrcin^: task, the average deviation 
of baseline estimates was greater for th.e latter group. With the added task 
of flying the sirralator, positive skcvnicss Increased substantially and ovortll 
estimate length decreased by 10^. While the absolute change in average de- 
viation with the addition of either concurrent task was numerically the same, 
it represented a increase with respect to baseline for the pilots fly- 

ing the simulator coiupared with a increase for the otter group. 

Duririg simulated flight, positive skewness incro-used, median estirrutte 
length decreased, and average deviation increased os the wind velocity was 
increased from ^ to 32 knots (Figure ]l). Similarly, with the addition of 
the predictor to the map display, positive skewness again increased, median 
estimate length decreased, and average deviation increased (Figure 12). The 
addition of the wind vector to the reap display again produced the same, though 
smaller, changes in all three measures of time production distributions 
(Figure 13). 

DISCUSSION 

Theoretically, one may distinguish two ways In which an individual con 
produce a time estimate: active and retrospective. Active estinistion hyro- 

theticaLLy Involves a conscious atterr^jt to keep track of time on a sustained 
basis durirjg an estli.-ate. For exarple, this may be done by counting off 
seconds. 'Phe various techniques used for active estiration each require a 
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noiorute its-X)unt ol uf-ontlon. Any -on * irrent fi ;tivity th-iL reqalros 

attention ?learly .•crx'Ctes wltn nrtive ectlr^tloti. V.7.en an addltlon/jl 
tack nicniontarlly divert/, attention iron estirs:>tlcn, cJo:k tir.e .-onLitue:; 
whereas subjective timekeej. Iry uct. Thus, the arxsunt of tir.e ti.nt 

has passed ray be undorestiratti, so that the r^sultir;*: produ -tlon is too 

loi;C. 

The time ostlmntion task ray be forfotten for rcLatively Icny periods 
of time as a consequence of attention paid to other activiti:-, resultlnr 
in very lone productions tr.at no loncer rej'resent 3ubje.:tive estiratec ol 
tine and are limited in lencth only by the maxicia durition allowed by the 
exj)orirr.ental desicn. If concurrent tasks exert hoa\'y attention deraude, 
active time estimation becomes Impossible. 

The retrospective mode of estimation hypothetically provides an alter 
native way to pi-oduce speC4.fled durations when concun’ent task .demands pre- 
clude active estimation. Usinj the retrospective rnde, the amount of time 
that has elapsed since the Le^jinnirit: of an interval is estimated at one or 
more discrete points. Tlie Icnrth of each such estimate is determined by 
one's memory of the events that occurred during the prcceedlng intervcal. 

The usual finding is that inteir/als filleu with many events and complex 
mental pro'cessing seem to last lojiger than they in fact do, an overesti- 
mation of elapsed time resulting in productions that are too short. Tie 
dacision to terminate the production is thus based on a cciq^ariscn between 
one's idea how much time has jessed since the beginning of the estimate 
and one's conception of the inter\'al of time being estimated. 



-b- 

Ketro.’pfcJtive fc^ttr;»tlcr. net i’^ iilre sjjtaincd attention to the 

passage of tlr.e thro’i*jhoat the Ir.ter'/al. Consequently, retrcspcotive 
estlMten sr.oaii not ier^anen a- u lun-tion ol dicti'acticn, as •ouid be 
expected of active cstlr^ttc. 

Tlie tine estin-ation task ;rjay be forgotten icr relatively lcn»: periods 
of tine daring retrospective, as well as active, estlnation, Tfie frequency 
of the resulting overly long prodictlonc should be greater as the denands of 
the concurrent task increase. Tl.e frequency of overly lore productiens 
should also be greater d'uring retrospective than active estimation, as a 
direct consequence of the fact that only Intermittent attention is paid to 
tiraekeeplrig in the retrospective node, effects ol concurrent activity 

on the central tendency of distributions of time productions are reiterated 
in Figure lb, Tl'.at figure also indicates the hypotl.es ized changes in 
variability and shape of estimate distributions , relative to baseline, 
under the two inodes of time ostir.stion. 

We in erred that the retrospective rode would dominate time estimates 
made during airaloted flight, because the very lature of the task should 
militate against pilots paying continuous and active attention to timekeeping'. 
Averaging across all pilots, the addition of display elements and other fac- 
tors relcva..t to the control task all were asso<'iated with distributions 
of estimates characterized by a decrease in central tendency and an increase 
in variability and positive skewness (Figure l^). Tliese arc the results th'it 
one would aspect with retrospective estimation. However, several pilots 
reported iittempts to actively ectinote time by count in,c. Those pilots gen- 
erated estinates which lengthened with increased concurrent activity, exact- 
ly 08 would be expected with active time estinntion. 
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T^u-' vl;.:ual dlsj layj '^nl ’ornltivc; j r^'occlnf rtv vcre 

complex .tni de:riiridln* lor •0355c:. .ritory tnc^cln#; t.'.un lor t..v fl'C”''* -Isi- 
ulatlon. '.>'0 Irduri’cd that I'elatlvoiy no**e ol estirr.ite^ '^tre riwli-’c-d 
actively li. the forr.icr citAatlon. 71;a3, .-oncurrent tra^rilnf' sr.O'ild exert 
a distructinc Iru'luencc on eatinjitlon, thereby increasing mf^dlan estirxite 
length. Indeed, the eatirr.ates rado durint: trackin;: avei-jged 5*0 coc lo.:ger 
than baseline ecti’tatcs and vere rxsrc than 6,0 sec longer than tho.e rade 
during simulated flight. Variability and iiositive ske'.niea3 also increased 
relative to baseline -with the addition of a tracking task (figure 15 ), 
However, tJ;e frequency ol very long productions and tl;e increase in 
variability was considerably less witii con^jeni^atory trackirg: than with sim- 
ulated flight, indicating: relatively less distraction. 

Within the tracking tack, the median estimate length and variability 
increased 'with addition of elt'ier a second axis or the more difficult for- 
cing. function, as would be exiiocted with actively produce 1 estimates. When 
both axes f well as tne raore difficult forcing functio.n wore comlinei, 
median est?‘tate length decreased whereas variability in-i’eased sharply. We 
infer that the demands of this particular condition :nade active estimation 
nxire difficult, resulting in a larger proportion of s’.orter, retrospective 
estimates .*th acco.’rqjanying increased variability. Such retrospective 
estimates would account for the apparent decrease in median estimate length 
reported for the addition of a .second axis ’when estimates were averaged 
across forcing function difficulty. 
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Hypcthet/i^ally, for tln.e c.'tl:7ite j. rod a 'tier.: •;» i'j y, lii- 

creasitv; taaK atteuticn dciximio should proer-?CGively lri.'roase thu •t.nti’al 
tendency of estir.atos relative to baseiln*^. However, n?tivo estlrvttion will 
be rendered difficult, if not irgjoauible, at higher 1 c’*''1g of llstr J''tlon, 
so that retrospC'ct ive estlciition rerjaln;^ the only c.odc available. Tr.c char;<:e 
frora the active to the retrosj active riode snould result in a discontinuity 
in the estimate length function, with associated desrease in the length of 
time productions, heciospcrtive estimate duration will then decre»use 
further with still creuter increases in the level of concurrent activity. 

The wrap-around effect with respect to baseline duration, a consequence of 
mode switchinc at intermediate levels of concurrent tas’< distrn .-tion, should 
contribute substantially to estirato variability and have a complex effect 
on the shape of the resulting: dlotricuticn of estisntes. 

Flrures lb, IT, l8, and 19 s'u:ara.rizo four measures of the estimate 
distributions for all of the cxperimcintul conditioris. An cxasqjlc of t!;e 
hypothetical wrap-around phenomicnon con be seen in Fic-ire lo, where the 
addition of a ti^ching task resulted In a 50vS Increase in the lei^Tth cf 
produced durations relative to baseline while the addition of a simulated 
fliCht resulted in a lO^j decrease in the lea^th of produced durations. As 
predicted, estimuito variability increased as a function of the* con^lcxity 
of concurrent activity. As can be seen in Fic'ure IT, the average deviation 
inci'eased by with the additional task of tracking and by with the 

additional tesk of sim.ulated flight. Tne expected increase in j'ositive 
skewness of the estimate distributions occurred for both groups of pilots 
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(Firuru lb) wlti. U.e •.tdditicr. cf a -xa? urrunt tojk. The diitrituti ons of 
ectiinater. -ade d-irlr<' slr^jlated tll^ht vei’e i*ortiC'xl!irly Jkeved as a 'cr.se- 
qaerce of the fe-^, cxtrerr.ely Loiw' d.»rjtioriJ U at vere rejordei when the 
concurrent task demnde-d so ruich attention that the tl^c ectlratlcn task 
was forcetten for relatively lorn: periods of tlr.e, KurtosJs, which Is a 
mearuro of t;.e peakednooo or flaenesa of n distribution, also differentiated 
estiraites obtuinec’ iurlnt sinajuitcd fllcht fron these obtained with no 
additional task or durlnc ?oiq:onsatory tracking, Estirates presumably 
made actively, such as those in the baseline coriditicns and with concurrent 
tracking, foimcd plat^ . ij*tlc or flattened distributions, whereas estl:.xites 
oelieved to have been rside retixupectlvely, such as these produced during 
simulated flight, formed leiitokurtic or peaked distributions (Figure 19). 

Tine esUimtion is nn unobtrusive and minimally loading task. Tl.e 
central tendency, variability, and shape of the distributioris of time 
productions provide indices of concurrent task processing requirements. 

Thus, time estimates my prove -useful to human factors researci.ers inter- 
ested in c .-rpjaring different ccriinations of displays and controls associated 
with con 5 )lf-x piloting tacks. 
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BLOCK DIAGRAM OF EXPERIME^TAL TRACKING TASKS 
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SIMULATED FLIGHT CONCURRENT TASK 



6 PILOTS 

6 ESTIMATES/CONDITION 
4 REPLICATIONS 








MOVING MAP HORIZONTAL SITUATION DISPLAY 




FIGURE 5 


STYLIZED DISTRIBUTIONS OF TIME ESTIMATES 
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FIGURE 6 



BASELINE ESTIMATES COMPARED TO THOSE 
PRODUCED DURING COMPENSATORY TRACKING 



CONCURRENT TASK 


INFLUENCE OF NUMBER OF CONTROLLED AXES 
ON TIME ESTIMATE DISTRIBUTIONS 



NUMBER OF CONTROLLED AXES 


INFLUENCE OF FORCING FUNCTION DIFFICULTY (BANDWIDTH) 
ON TIME ESTIMATE DISTRIBUTIONS 



FORCING FUNCTION DIFFICULTY 


BASELINE ESTIMATES COMPARED TO THOSE 
PRODUCED DURING SIMULATED FLIGHT 
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FIGURE 10 



INFLUENCE OF WIND VELOCITY ON DISTRIBUTIONS OF 
TIME ESTIMATES PRODUCED DURING SIMULATED FLIGHT 
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FIGURE 11 





INFLUENCE OF THE WIND VECTOR ON DISTRIBUTIONS 
OF TIME ESTIMATES PRODUCED DURING SIMULATED FLIGHT 
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ABSENT PRESENT ABSENT PRESENT ABSEN"^ PRESENT 

GRAPHIC WIND VECTOR 



THE INFLUENCE OF CONCURRENT ACTIVITY 
ON DISTRIBUTION OF TIME PRODUCTIONS 
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FIGURE 14 
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FIGURE 15 



COMPENSATORY TRACKING CONCURRENT TASK 



NONE SIMULATED 4 KNOTS 32 KNOTS ABSENT PRESENT ABSENT PRESEN 

FLIGHT 

CONCURRENT TASK WIND PREDICTOR WIND VECTOR 

Figure i6 




CONCURRENT TASK WIND PREDICTOR WIND VECTOR 
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NOTE: ♦ GAMMA 2 « LEPTOKURTIC (PEAKED) 
- GAMMA 2 = PLATYKURTIC (FLAT) 


